data of a first frame that is output from the camera is temporarily stored in a frame memory. 
Thereafter, picture data of a second frame that is photographed is stored in another frame 
memory. The calculating apparatus synchronously reads the contents (namely, picture data) 
stored in the frame memories and calculates the difference of the corresponding pictures. 
5 However, since picture data is transferred from the camera to the frame memories in the 

serial method, the transfer time for one screen can be rather long. For example, in an NTSC 
(National Television System Committee) type camera of which the CCD is used as a 
photographing device, while a picture of one frame is being photographed, a picture of the 
preceding frame is read. Thus, until a picture of one frame is read and transferred, it takes as 
10 long as 33 msec. Consequently, after a picture is photographed, until the calculated result is 

obtained, it takes at least 33 msec. 
O Figure 10 shows a timing chart of which a photographed picture is stored and read in the 

!« CCD as a photographing device. As shown in Figure 10, it takes 33 msec until a picture of each 

: 1ST 

Ft 

of odd fields and even fields is stored. Additionally, as shown in Figure 10, unless the read 
Ipi period for a picture of the second frame elapses, the calculated result cannot be obtained. 

Thus, it is difficult to apply the conventional photographing system using a camera 
! »3 composed of a CCD photographing device to a controlling system using visual information such 

in 

□ as visual feedback. 

^ Conversely, in a prototype CMOS image sensor, the frame rate is raised to as high as 

2iy around 1 kHz and while pictures are being photographed at very high speed, a calculating 

process is successively performed so as to accomplish the visual feedback. However, in such a 
sensor, since internal processes are digitally performed, it is necessary to provide, for example, 
an A/D converting circuit for converting analog values into digital values, a storing circuit for 
storing digital values, and a calculating circuit for calculating digital values. Since these circuit 

25 modules have large circuit scales, they are not suitable for a many-pixel device. Thus, it is 
difficult to commercially use such a sensor (refer to "Designing ultra parallel, ultra high speed 
vision chip using general purpose processing element (translated title) 11 by Komuro et. al., 
Journal of The Institute of Electronics, Information and Communication Engineers, Japan, Vol. 
J81-D-1, No. 2, pp. 70 - 76, 1998). 

30 Additionally, a CMOS image sensor for calculating analog signals as they are has been 

proposed. In such sensors, a memory function is accomplished by storing a signal voltage to a 
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capacitor. Thus, depending on how a capacitor is structured, each pixel becomes large. Even if 
the number of pixels can be increased by disposing a memory portion at a non-pixel area, such a 
method is not suitable for reducing the size of the chip. 

Also, when a signal voltage is stored to a capacitor, if a signal voltage of another 
capacitor is read as a gate voltage of another transistor, since threshold voltages of individual 
transistors fluctuate, there is a risk that a signal may be read as a different value. As a result, the 
calculated result may contain an error. In addition, when a signal voltage is stored to a capacitor, 
since the charging time cannot be ignored, such sensors are not suitable for high speed processes. 

SUMMARY OF THE INVENTION 

An advantage of the present invention is, therefore, to provide an excellent picture 
processing apparatus for obtaining the difference between picture frames so as to obtain a 
temporal change in brightness of an object. 

Another advantage of the present invention is to provide an excellent picture processing 
apparatus in which a photographing device and a storing portion for storing photographed data 
are disposed on the same circuit so as to perform a calculating process at high speed. 

A further advantage of the present invention is to provide an excellent picture processing 
apparatus that allows characteristics of a storing portion to be suppressed from fluctuating and an 
accurately calculated output to be obtained in a situation where a temporal change of brightness 
of an object is small. 

A picture processing apparatus according to an embodiment of the present invention 
includes a light receiving portion for generating an electric signal corresponding to the intensity 
of received light. An amplifying portion is provided for amplifying an output signal of the light 
receiving portion. A number of storing portions are provided for storing, as a current signal, an 
electric signal amplified by the amplifying portion. Also provided is a load portion for 
converting current outputs of the number of storing portions into voltages. A bias portion is 
provided for supplying an offset current to an input of the load portion. Also provided is a 
calculating portion for calculating an output signal of the load portion. An outputting portion is 
provided for outputting a calculated result of the calculating portion to the outside. 

The storing portions may store current signals corresponding to the received light in 
different periods. Preferably, the calculating portion performs a calculating process such as 
addition, subtraction, or a comparison for the voltage signals based on the current signals 



extracted from at least two of the storing portions. The amplifying portion may contain mirror 
transistors that are connected so that their gate electrodes face each other and amplify the current 
signals based on the theory of current mirror amplification. The storing portion may store the 
current signals based on the theory of a current copier circuit. Preferably, when the calculating 
5 portion compares the signal currents supplied from two of the storing portions, the bias portion 
may add an offset current to a signal current supplied from one of the two storing portions but 
does not add the offset current to the signal current supplied from the other storing portion. As a 
result, the influence of an output to the calculating portion due to characteristic fluctuations of 
the individual storing portions can be suppressed. 

1 0 According to another embodiment of the present invention, a photographing device 

having a number of pixels arranged on the same circuit in a matrix is provided for detecting the 

q brightness of an object. Each of the pixels includes a light receiving portion for generating an 

'2 electric signal corresponding to the intensity of received light. An amplifying portion amplifies 

U 

',9 an output signal of the light receiving portion. An electric signal amplified by the amplifying 

HQ 

portion is stored as a current signal in a number of storing portions. A load portion is provided 
^ for converting the current outputs of the number of storing portions into voltages. A bias portion 

ti 

□ is provided for supplying an offset current to an input of the load portion, and a calculating 

I n 

1^ portion is provided for calculating an output signal of the load portion. Finally, an outputting 

[J portion is provided for outputting a calculated result from the calculating portion. 

□ 

20 Preferably, in the photographing device, the storing portions may store current signals 

corresponding to the received light in different periods. The calculating portion may perform a 
calculating process such as addition, subtraction, or a comparison for the voltage signals based 
on the current signals extracted from at least two of the storing portions. The amplifying portion 
may contain mirror transistors that are connected so that their gate electrodes face each other and 

25 amplify the current signals based on the theory of current mirror amplification. The storing 

portion may store the current signals based on the theory of a current copier circuit. Preferably, 
when the calculating portion compares the signal currents supplied from two of the storing 
portions, the bias portion may add an offset current to a signal current supplied from one of the 
two storing portions but does not add the offset current to the signal current supplied from the 

30 other storing portion. As a result, the influence of an output to the calculating portion due to 
characteristic fluctuations of the individual storing portions can be suppressed. 
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According to yet another embodiment of the present invention, a photographing device 
for detecting the brightness of an object is provided. The photographing device includes a pixel 
area in which pixels are arranged in a matrix, each pixel being composed of a light receiving 
portion for generating an electric signal corresponding to the intensity of received light and an 

5 amplifying portion for amplifying an output signal of the light receiving portion. The 
photographing device further includes a second amplifying portion area in which second 
amplifying portions are arranged in each column of the matrix of the pixels in the pixel area. 
Each of the second amplifying portions amplifies a current signal based on the theory of current 
mirror amplification of mirror transistors that are connected so that their gate electrodes face 
10 each other. Also included in photographing device is a pixel-outside storing area in which a 

lis number of storing portions are arranged in a matrix corresponding to the arrangement of the 

n 

pixels in the pixel area, each of the storing portions storing, as a current signal, an electric signal 
[ '5 that has been amplified. Still further, the photographing device includes a load portion and 
jig calculating portion area in which load portions and calculating portions are arranged in each 

! P 

l'| column of the matrix of the pixels of the pixel area, each of the load portions converting the 
j; current output of the corresponding storing portion into a voltage and each of the calculating 
|,f| portions performing a calculating process. The photographing device also includes an outputting 
!|J portion area in which outputting portions are arranged in each column of the matrix of the pixels 
of the pixel area, each of the outputting portions outputting the calculated result of the 

ru 

20 corresponding calculating portion. Preferably, the pixel area, the second amplifying portion area, 
the pixel-outside storing area, the load portion and calculating portion area, and the outputting 
portion area are disposed on the same circuit. 

The storing portions may store current signals corresponding to the received light in 
different periods. The calculating portions may perform a calculating process such as addition, 

25 subtraction, or a comparison for the voltage signals corresponding to the current signals extracted 
from two or more of the storing portions. The photographing device may further include a bias 
portion for adding an offset current to an output current of the corresponding storing portion. In 
such a structure, when the calculating portion compares the signal currents supplied from two of 
the storing portions, the bias portion may add an offset current to a signal current supplied from 

30 one of the two storing portions but does not add the offset current to the signal current supplied 
from the other storing portion. As a result, the influence of an output to the calculating portion 
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due to characteristic fluctuations of the individual storing portions can be suppressed. The 
storing portion may store the current signals based on the theory of a current copier of circuit. 

In an embodiment, a picture processing apparatus includes a light receiving portion for 
generating an electric signal corresponding to intensity of received light, an amplifying portion 
5 for amplifying an output signal of the light receiving portion, a number of storing portions for 
storing, as a current signal, an electric signal amplified by the amplifying portion, a load portion 
for converting current outputs of the storing portions into voltages, a bias portion for supplying 
an offset current to an input of the load portion, and a calculating portion for calculating an 
output of the load portion. 
10 According to an embodiment of the structure of the picture processing apparatus of the 

present invention, since a storing portion and a photographing device are disposed on the same 
□ circuit, the process can be performed at a high speed. In addition, since a bias portion adds an 
q offset current to a current signal that is output from the storing portion and that has not been 

:^ calculated, the influence of characteristics of the storing portion can be suppressed, thereby 

?.y 

IB allowing an output of the calculating portion to become stable. 

For example, when the picture processing apparatus according to an embodiment of the 
: g present invention is used as a pixel and each pixel is arranged in a matrix on the same circuit, a 

in 

Q photographing device with a calculating function can be structured. With the photographing 
im device, a temporal change of brightness of an object can be calculated at high speed. 
28 Additional features and advantages of the present invention are described in, and will be 

apparent from, the following Detailed Description of the Invention and the figures. 

BRIEF DESCRIPTION OF THE FIGURES 
Figure 1 is a schematic diagram showing the structure of a circuit of a photographing 
device according to an embodiment of the present invention. 
25 Figure 2 is a schematic diagram showing the internal structure of a pixel disposed in the 

photographing device according to an embodiment of the present invention. 

Figure 3 is a schematic diagram showing the structure of an embodiment of a circuit 
including a light receiving portion, a first amplifying portion, a second amplifying portion, and 
storing portions. 

30 Figure 4 is a schematic diagram showing the structure of an embodiment of a circuit 

including a loading portion and calculating portion and an outputting portion. 
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Figure 5 is a timing chart showing operational characteristics of a photographing device 
according to an embodiment of the present invention. 

Figure 6 is a timing chart showing operational characteristics of current signals stored in 
storing portions which are compared according to an embodiment of the present invention. 
5 Figure 7 is a schematic diagram showing an embodiment of the structure of a circuit 

including a bias portion. 

Figure 8 is a schematic diagram showing an embodiment modifying the structure of the 
photographing device shown in Figure 1 and the structure of the pixel shown in Figure 2. 

Figure 9 is a schematic diagram showing another embodiment modifying the structure of 
10 the photographing device shown in Figure 1 and the structure of the pixel shown in Figure 2. 
I j_ Figure 10 is a timing chart showing a photographed picture being stored and read when a 

j '3 CCD is used as the photographing device. 

! ,B =5 

□ Figure 1 1 is a timing chart showing operational characteristics of the photographing 

f ;| device shown in Figure 9. 

\B Figure 12 is a schematic diagram showing the structure of an active type distance 

u measuring system to which the photographing device according to an embodiment is applied. 
I ! ^ Figure 13 is a plan view showing the distance measuring system shown in Figure 12. 

O Figure 14 is a schematic diagram showing a temporal change of light intensity that a 

Q photographing device receives and a calculated result of the change of the intensity by the 
2I9 photographing device. 

DETAILED DESCRIPTION OF THE INVENTION 
Figure 1 schematically shows the structure of a circuit of a photographing device 
according to an embodiment of the present invention. As shown in Figure 1, the photographing 
device is composed of m x n pixels 1 arranged in a matrix shape. On the respective lines of the 
25 matrix, horizontal pixel drive signal groups 81-1, 81-2, 81-n are disposed. On the respective 
columns of the matrix, vertical signal lines 91-1, 91-2, 91 -m are disposed. 

The horizontal pixel drive signal groups 81 contain signals that synchronously drive each 
portion of the pixels. The signals are output from a vertical driving circuit 80. The vertical 
signal lines are signal lines for outputting photographed picture signals of the pixels. The 
30 vertical signal lines 91 are disposed toward a horizontal outputting portion 100. 
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Figure 2 shows the internal structure of an embodiment of one of the pixels 1 arranged in 
the photographing device. As shown in Figure 1, the pixel 1 is composed of a light receiving 
portion 10, a first amplifying portion 20, a second amplifying portion 30, k storing portions of a 
first storing portion 10-1 to a k-th storing portion 40-k, a load and calculating portion 50, a bias 
portion 55, and an outputting portion 60. 

The light receiving portion 10 is a photoelectric converting portion. Conventionally, the 
light receiving portion 10 is composed of a photo diode (PD) or the like. The operation of the 
light receiving portion 10 is controlled by a light receiving portion drive signal 11. 

The first amplifying portion 20 converts a current signal transferred from the light 
receiving portion 10 into a level suitable for a process of the second amplifying portion 30 on the 
next stage of the first amplifying portion 20. In addition, the first amplifying portion 20 outputs 
the current signal at a timing defined by a first amplifying portion drive signal 21 . 

The second amplifying portion 30 converts a current signal transferred from the first 
amplifying portion 20 into a level suitable for a processing process of each storing portion 40 on 
the next stage. In addition, the second amplifying portion 30 outputs the current signal at a 
timing defined by a second amplifying portion drive signal 31. 

The k storing portions of the first storing portion 40-1 to the k-th storing portion 40-k are 
connected to an output of the second amplifying portion 30. The k storing portions store and 
hold the current of the amplified signal at a proper timing defined by a storing portion drive 
signal 41 . The number k of storing portions disposed in one pixel depends on a calculating 
process performed in the next stage. 

The load portion and calculating portion 50 is connected to all outputs of the first storing 
portion 40-1 to the k-th storing portion 40-k. The load portion and calculating portion 50 
converts output currents of all or part of the storing portions 40 into corresponding voltages. In 
addition, the load portion and calculating portion 50 performs a calculating process at a proper 
timing defined by a calculating portion drive signal 51 . Although the calculating process 
depends on the function of the photographing device, the calculating process includes an 
addition, a subtraction, a comparison, and the like of signals. 

The bias portion 55 generates a bias current for eliminating noise corresponding to a bias 
portion drive signal 56 thereby enabling the calculating portion 50 to properly perform the 
calculating process. 
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The outputting portion 60 converts the calculated result of the load portion and 
calculating portion 50 into a level suitable for an output to signal lines of the photographing 
device. The outputting portion 60 outputs the converted signal as a pixel output 70 at a proper 
timing corresponding to an outputting portion drive signal 61 . 
5 The drive signals 11 to 61 for each portion are supplied as the horizontal pixel drive 

signal groups 81 to each pixel 1 of the photographing device. A vertical driving circuit 80 
generates the drive signals 11 to 61 and drives m pixels arranged in the horizontal direction with 
the drive signals 11 to 61. 

A pixel output 70 of each pixel is connected with the vertical signal lines 91, each of 
10 which connects pixels arranged in the column (vertical) direction. The vertical signal lines 91-1, 
I 1 * 91-2, ... 91 -m are connected to the horizontal outputting portion 100 and extracted as a 
□ photographed picture signal 101 outside the photographing device. 

~ When the number m of pixels that are horizontally arranged in the photographing device 

*!0 is small, the pixel output 70 may be converted into a proper level and then extracted as m parallel 

Ml 

15 outputs outside the photographing device. 

" The structure of a practical circuit of the pixel 1 according to an embodiment will be 

•5=5 

in described with reference to Figure 3. As shown in Figure 3, the structure of the circuit includes 

G 

ijl the light receiving portion 10, the first amplifying portion 20, the second amplifying portion 30, 

and the first storing portion 40-1 to the k-th storing portion 40-k. 
20 The light receiving portion 10 is composed of a photodiode (PD) or the like, a reset 

transistor (QR), and a transfer transistor (QX). A reset pulse (RST) is input to a gate terminal of 

the reset transistor (QR). A transfer pulse (TX) is input as light receiving portion drive signals 

1 1 a and 1 lb to a gate terminal of the transfer transistor (QX). 

The first amplifying portion 20 is composed of an amplifying transistor (QA) and a read 
25 transistor (GR1). A read pulse (RD) is input as a first amplifying portion drive signal 21 to a 

gate terminal of the read transistor (GR1). 

The second amplifying portion 30 is composed of a current mirror circuit and a read 

transistor (GR2). The current mirror circuit is composed of a mirror transistor (CM1) and a 

mirror transistor (CM2) whose gate electrodes face each other. A write pulse (WR) that defines 
30 a signal transfer timing for the storing portions 40 in the next stage of the second amplifying 

portion 30 is input as a second amplifying portion drive signal 31 to the read transistor (GR2). 
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Each of the first storing portion 40-1 to the k-th storing portion 40-k is composed of a 
memory transistor (Ml to Mk), a memory gate transistor (Gl to Gk), and a memory switch (SW1 
to SWk). A storage pulse (CK1 1 to CKkl) and a storage pulse (CK12 to CKk2) are input as 
storing portion drive signals 41a and 41b to the memory switch (SW1 to SWk) and the memory 
gate transistor (Ml to Mk), respectively. 

An output signal of the second amplifying portion 30 and input and output signals of the 
first storing portion 40-1 to the k-th storing portion 40-k are connected with a common signal 
line. In the following description, a current that passes through the signal line is denoted by a 
common signal IM. 

Figure 4 shows the structure of an embodiment of a circuit of the load portion and 
calculating portion 50 and the outputting portion 60. 

The load portion and calculating portion 50 is composed of a load transistor (QL), an 
inverter (INV1), an inverter (INV2), a capacitor (CAP1), a capacitor (CAP2), an inverter switch 
(SWA), and an inverter switch (SWB). 

An inverter pulse CKA and an inverter pulse CKB are input as calculating portion drive 
signals 51a and 51b to a gate terminal of the inverter switch (SWA) and a gate terminal of the 
inverter switch (SWB), respectively. 

A load bias voltage (VL) is input to a gate terminal of the load transistor (QL). The load 
bias voltage (VL) defines the operation point of the load transistor (QL). 

The capacitor (CAP1), the inverter (INV1), and the inverter switch (SWA) compose one 
chopper type comparator. Likewise, the capacitor (CAP2), the inverter (INV2), and the inverter 
switch (SWB) compose one chopper type comparator. 

The outputting portion 60 is composed of a buffer amplifier (BA) and a pixel output gate 
(PTX). An output pulse (CK0) is input as an outputting portion drive signal 61 to a gate terminal 
of the pixel output gate (PTX). An output of the pixel output gate (PTX) becomes a pixel output 
(V0) of the pixel 1. 

Next, operational characteristics of one pixel 1 will be described. The operation of the 
pixel 1 can be categorized as a reset period, a transfer period, a storage period, a calculation 
phase 1, and a calculation phase 2. 
Reset Period 
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First, when the reset pulse (RST) is applied, the reset transistor (QR) is activated. As a 
result, the voltage on the drain side of the reset transistor (QR) (namely, a received light signal 
voltage (VA)) is set to a predetermined voltage corresponding to the power supply voltage (the 
predetermined voltage is temporarily denoted by VR). 
Transfer Period 

Thereafter, when a transfer pulse (TX) is applied, the transfer transistor (QX) is activated. 
As a result, in the storage period, signal electric charges (electrons) that have been photo- 
electrically converted by the photodiode (PD) of the light receiving portion 10 are transferred to 
the drain side of the reset transistor (QR). As a result, the received light signal voltage (VA) 
becomes the voltage corresponding to the number of signal electric charges. 
Storage Period 

The received light signal voltage (VA) is the gate voltage of the amplifying transistor 
(QA) of the first amplifying portion 20. Thus, when a read pulse (RD) is applied, the read 
transistor (GR1) is activated. As a result, a signal current corresponding to the received light 
signal voltage (VA) flows to the mirror transistor (CM1) of the second amplifying portion 30. 

As a result, due to the theory of current mirror (i.e., amplification utilizing a current 
mirror circuit), a current with an amount that depends on the size ratio of the mirror transistor 
(CM1) flows to the other mirror transistor (CM2). 

When a write pulse (WR) is applied, the read transistor (GR2) of the second amplifying 
portion 30 is activated. In addition, when a storage pulse (CK12) is applied, the memory gate 
transistor (Gl) of the first storing portion 40-1 is activated. Moreover, when a storage pulse 
(CK1 1) is applied, the memory switch (SW1) of the first storing portion 40-1 is activated. As a 
result, a current that passes through the mirror transistor (CM2) flows to the memory transistor 
(Ml). 

In addition, when the memory switch (SW1) is deactivated and then the memory gate 
transistor (Gl) and the transistor (GR2) are deactivated, the current that flows to the memory 
transistor (Ml) can be stored. 

The storing operation is accomplished in such a manner that the gate voltage that defines 
the value of the current that flows between the source and the drain of the memory transistor 
(Ml) is charged to a relatively smaller gate capacity (i.e., the theory of current copier employing 
a current copier circuit). Thus, it is not necessary to charge a large capacity such as a capacitor. 
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As a result, since the storing operation is completed in a short period, the operation time of the 

pixel 1 can be shortened. 

In the embodiment described above, a current that corresponds to the received light signal 

voltage (VA) is stored to the memory transistor (Ml) of the first storing portion 40-1 . This 
5 operation can apply to a current that corresponds to the received light signal voltage (VA) that is 

stored to the other storing portions 40-2, 40-k. 

Thus, when a signal that has been photo-electrically converted in another period is stored 

to the memory transistor of another storing portion 40, a calculation (for example, a comparison 

between signals) can be accomplished in the pixel 1 . 
10 It is assumed that respective currents that correspond to signals that have been photo- 

u electrically converted in different periods have been stored in the memory transistor (Ml) of the 
!;S first storing portion 40-1 and the memory transistor (M2) of the second storing portion 40-2. 
! '3 Thus, the currents that have been stored in the transistors Ml and M2 are denoted by IM1 and 
i;Q IM2, respectively. 

Calculation Phase 

n_ When the memory gate transistor (Gl) of the first storing portion 40-1 is activated, the 

|,h current IM1 stored in the memory transistor (Ml) flows to the load transistor (QL). As a result, a 
| in voltage (temporarily denoted by VI) that depends on the amount of the current IM1 and the load 
'3 bias voltage (VL) takes place on the electrode A side of the capacitor (CAP1). 

ru 

20 However, when the load bias voltage (VL) is applied in only the period of the calculation 

phase 1 and the loading bias voltage (VL) is 0 V in other periods, a current can be prevented 

from flowing to the load transistor (QL). 

When the inverter switch (SWA) is activated so that the input and the output of the 

inverter (INV1) is short-circuited, a voltage (Vinvl) at the operation point of the inverter (INV1) 
25 takes place on the electrode B side of the capacitor (CAP1). As a result, a potential of the 

difference between VI and Vinvl takes place between the A side and the B side of the capacitor 

(CAP1). 

In addition, after the inverter switch (SWB) that short-circuits the input and the output of 
the inverter (INV2) is activated along with the inverter switch (SWA), the inverter switch (SWB) 
30 is deactivated just after the inverter switch (SWA) is deactivated. At that point, the output 
voltage (Vol) of the inverter (INV1) and the voltage (Vinv2) at the operation point of the 
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inverter (INV2) are applied on the C side and the D side of the capacitor (CAP2). Thus, a 
potential of the difference takes place between both the sides. 

It should be noted that when the inverter switch (SWA) is deactivated from the activated 
state, each voltage on the input side and the output side of the inverter (INV1) may slightly 
5 fluctuate from voltages that take place when they are short-circuited due to the effect of charge 
injection. In the embodiment shown in Figure 4, such a voltage fluctuation component can be 
absorbed by the capacitor (CAP2). 
Calculation Phase 2 

Thereafter, when the memory gate transistor (G2) of the second storing portion 40-2 is 
10 activated, the current IM2 that is stored in the memory transistor (M2) flows to the load 

i f transistor (QL). As a result, a voltage (temporarily denoted by V2) that depends on the amount 

'•3 

□ of the current IM2 and the load bias voltage (VL) takes place on the electrode A side of the 

|| capacitor (CAP2). 

«'!Q When the voltage V2 is higher than the voltage VI, assuming that the input capacitance 

in 

!•§ of the inverter (INV1) is so small that it can be ignored (i.e., it is negligible), the voltage on the B 



.0 
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n 



side of the capacitor (CAP1) rises by V2 - VI from the voltage (Vinvl) at the operation point. 
Thus, the signal level of the output of the inverter (INV1) becomes low. 

As a result, the voltage on the electrode D side of the capacitor (CAP2) becomes lower 
than the voltage (Vinv2) at the operation point. Thus, the signal level of the output of the 



ru 

20 inverter (INV2) becomes high. 

In contrast, when the voltage V2 is lower than the voltage VI, the voltage of the electrode 
B side of the capacitor (CAP1) lowers by VI - V2 from the voltage (Vinvl) at the operation 
point. Thus, the signal level of the output of the inverter (INV1) becomes high. 

As a result, the voltage on the electrode D of the capacitor (CAP2) becomes higher than 
25 the voltage (Vinv2) at the operation point. Thus, the signal level of the output of the inverter 
(INV2) becomes low. 

In other words, when the current IM2 stored in the memory transistor (M2) of the second 
storing portion 40-2 is larger than the current IM1 stored in the memory transistor (Ml) of the 
first storing portion 40-1, the signal level of the output of the calculating portion 50 becomes 
30 high. In contrast, when the current IM1 is larger than the current IM2, it is clear that the signal 
level of the output of the calculating portion 50 becomes low. 
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In such a manner, the calculating portion 50 can compare the amounts of current stored in 
the storing potions 40 (namely, comparing the intensity or brightness of the received light). 

An output of the calculating portion 50 is amplified to a proper level by the buffer 
amplifier (BA) of the outputting portion 60. When an output pulse (CKO) is applied, the pixel 
5 output gate (PTX) is activated. As a result, the amplified output is output as a pixel output VO. 

In the above-described operation, a calculated result for one pixel is obtained as a pixel 
output. Thus, when such phases from storage period to calculation phase 2 are repeated 
corresponding to the number of pixels, pixel outputs can be obtained from the pixels 1 that are 
arranged in the vertical direction. 
10 Figure 5 shows operational characteristics of a photographing device according to an 

l & embodiment in the format of a timing chart. However, in Figure 5, only clocks for two pixels are 

.1X3. 

q illustrated. 

! '3 In Figure 5, reset period and transfer period are in common with all pixels. Alternatively, 

i;0 even if reset period and transfer period differ in each pixel, the above-described operations can 

lS be accomplished. However, in the latter case, the timing of the photo-electrically conversion 

'] slightly deviates in each pixel. 

IJ] In the above-described embodiment, two current signals that are stored are compared. 

H 

However, in the structure of the pixel 1 according to an embodiment, three or more current 

> if - 

O signals can be compared. 

ru 

20 In an embodiment, it is understood that four storing portions of first to fourth storing 

portions 40-1 to 40-4 are disposed and that signals currents IM1, IM2, IM3, and IM4 that have 
been received and photo-electrically converted are stored to memory transistors Ml to M4, 
respectively. 

In the calculation phase 1 of the load portion and calculating portion 50, the memory gate 
25 transistors Gl and G2 are activated at the same time. Thus, the signal currents IM1 and IM2 
flow to the load transistor (QL). As a result, the load current VI takes place. 

In the calculation phase 2, the memory gate transistors G3 and G4 are activated at the 
same time. Thus, the signal currents IM3 and IM4 flow to the load transistor (QL). As a result, 
the load current V2 takes place. 
30 According to an above-described embodiment, when V2 is larger than VI, the signal 

level of the output of the calculating portion 50 becomes high. In contrast, when V2 is smaller 
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than VI, the signal level of the output of the calculating portion 50 becomes low. In such a 
manner, the signal currents IM1, stored in the plurality of storing portions 40-1 can be 
compared. 

Figure 6 shows operational characteristics in the case that the signal currents IM1, ... 
5 stored in the plurality of storing portions 40-1, ... are compared in the form of a timing chart. 
However, in Figure 6, drive clocks for one pixel are illustrated. 

Figure 7 shows the structure of an embodiment, a circuit of the bias portion 55. The bias 
portion 55 adds an offset current to the input signal IM of the load portion and calculating 
portion 50 so as to eliminate influence of noise or the like. 
10 As shown in Figure 7, in an embodiment the bias portion 55 is composed of a bias load 

! transistor (BQL), a bias transistor (BQ1), and a bias transistor (BQ2). The bias transistor (BQ1) 
■3 and the bias transistor (BQ2) form a current mirror circuit. An offset bias voltage (VB) is 
□ applied to the gate terminal of the bias load transistor (BQL). The operation point of the bias 
'5 load transistor (BQL) is varied by the offset bias voltage (VB). An output of the bias transistor 

1,0 

18 (BQ2) is extracted as a bias current (IB). 

„ In the structure shown in Figure 7, the offset bias voltage (VB) can be controlled from the 

: rf outside. In the calculation phase 1, the bias current (IB) is added to the signal current that is 

rjj 

Q extracted from the storing portion 40 and supplied to the load transistor (QL) of the calculating 

m 

q portion 50. In contrast, in the calculation phase 2, the bias current (IB) is not added to the 
IB extracted signal current. As a result, the output of the calculating portion 50 becomes stable. 

When the signal levels of two signals that are compared are almost the same and slightly 
change time by time, the output of the calculating portion 50 repeatedly and unstably changes 
between the high level and the low level. To overcome this problem, as was described above, a 
bias current is superimposed to a current extracted in the calculation phase 1 so that the current 
25 extracted in the calculation phase 1 is larger than a current extracted in the calculation phase 2. 
As a result, the output of the calculating portion can be kept to either the low level or the high 
level (in an embodiment, kept in the low level) such that the output of the calculating portion 50 
becomes stable. 

When the current extracted in the calculation phase 2 is larger than the sum of the bias 
30 current component and the current extracted in the calculation phase 1 , the output of the 
calculating portion 50 changes from the low level to the high level. 
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It is determined whether or not a current flows to the bias load transistor (BQL) 
depending on whether the offset bias voltage (VB) is applied. As a result, the value of the bias 
current (IB) depends on the effect of current mirror. However, to accurately control the value of 
the current, it is necessary to accurately control the offset bias voltage (VB). Thus, there is a 
5 situation in which the offset bias voltage (VB) cannot be accurately controlled. In particular, the 
threshold voltage of the bias load transistor (BQL) fluctuates. The bias current (IB) varies for 
each pixel. Thus, the result may vary. 

To overcome this problem, an embodiment of the present invention varies the amount of 
the bias current (IB) by an amount related to the difference in value of the offset bias voltage 
10 (VB) rather than the absolute value of the offset bias voltage (VB), so that an output of the 
calculating portion 50 can become stable. 

|{* 

□ In an embodiment, in the calculation phase 1, the offset bias voltage VB1 is applied to the 

i'3 

13 bias load transistor (BQL). The bias current that flows at the time is denoted by IB2. Next, in 

tas. 

J;^ the calculation phase 2, when the offset bias voltage is denoted by VB2, the bias current is 
15 denoted by IB2. When the threshold voltages of the bias load transistors (BQL) are different 
H from each other, the absolute values of IB1 and IB2 may largely vary. However, the difference 
; * IB1 - IB2 can be remarkably suppressed. As a result, the current difference supplied as a bias 
Q becomes stable in the calculation phase 1 and the calculation phase 2. 

j£j In addition, considering the effect of current mirror, when the sizes of the transistors are 

M designed so that the current that flows in the bias transistor (BQ2) is smaller than the current that 
flows in the bias transistor (BQ1) (namely, the bias load transistor (BQL)), the influence of the 
fluctuation of the threshold voltage can be reduced. 

Next, with reference to Figure 3, in the pixel 1 according to an embodiment of the present 
invention, the characteristics (namely, threshold voltages) of the memory transistors Ml to Mk 
25 as structural elements of the storing portions 40 can be suppressed from fluctuating. 

In an embodiment, it is understood that the gate voltage VA of the amplifying transistor 
(QA) of the first amplifying portion 20 is constant. 

When a read pulse (RD) is applied, the read transistor (GR1) is activated. As a result, a 
predetermined amount of current flows to the mirror transistor (CM1) that composes the current 
30 mirror. 
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Conversely, a predetermined amount of current that depends on the size ratio of the 
transistor CM1 flows in the other mirror transistor (CM2) that composes the current mirror as 
long as the mirror transistor (CM2) operates in the saturation region. In an embodiment, the 
predetermined amount of current is temporarily denoted by IMA. 

When the read transistor (GR2), the memory gate transistor (Gl), and the memory switch 
(SW1) are activated at the same time, IMA flows to the memory transistor (Ml). 

At that point, the threshold voltage and the gate voltage (= drain voltage) of the memory 
transistor (Ml) are denoted by Vth-1 and VG-1, respectively. The common signal voltage 
between the memory gate transistor (Gl) and the read transistor (GR2) is denoted by VM-1. 

Likewise, when the above-described operation is performed for the memory transistor 
(M2) rather than the memory transistor (Ml), the current IMA flows to the memory transistor 
(M2). At that point, the threshold voltage and the gate voltage (= drain voltage) of the memory 
transistor (M2) are denoted by Vth-2 and VG-2, respectively. The common signal voltage 
between the memory gate transistor (G2) and the read transistor (GR2) is denoted by VM-2. 

When the size of the memory transistor (Ml) is completely the same as that of the 
memory transistor (M2) and the threshold value of the former is the same as that of the latter 
(namely, Vth-1 = Vth-2), as long as the same current flows thereto, the relations of VG-1 = VG- 
2 and VM-1 = VM-2 are satisfied. 

However, although the sizes of the transistors are the same, if their threshold voltages are 
different (namely, Vth-2 = Vth-1 + AVth) due to fluctuations in production (or another cause), to 
allow the same current IMA to flow thereto, it is necessary to change the gate voltage VG-2 of 
the memory transistor by AVG and the common signal voltage VM-2 by AVM. 

Such voltage changes affect the drain voltage of the mirror transistor (CM2) of the 
current mirror circuit of the second amplifying portion 30. Unless the mirror transistor (CM2) 
operates in the saturation region, the current IMA does not flow unlike in the normal case. 

Thus, when the sizes of the memory transistors, the memory gate transistors, the read 
transistors, and the mirror transistors are properly selected, they have proper margins of 
operation points. In addition, when the mirror transistor is designed so that it always operates in 
the saturation state, even if voltage fluctuations AVG and AVM due to fluctuations of the 
threshold voltages take place, the signal current IMA that is stored does not change. 
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Figure 8 shows an embodiment modifying the structure of the photographing device 
shown in Figure 1 and the structure of the pixel shown in Figure 2. 

It should be understood from the timing charts shown in Figures 5 and 6, with n pixels 
arranged in the vertical direction, although the reset and transferring operation may be performed 
at the same time, the storing operation and the calculating operation can be performed at 
different times. Thus, it is not always necessary to dispose the second amplifying portion 30 
(which generates a signal current to be stored), the load portion and calculating portion 50 
(which processes a signal generated by the storing portion 40), the outputting portion 60, and the 
bias portion 56 in each pixel. In an embodiment, they can be shared by a plurality of pixels. 

When these structural elements are disposed in each pixel, as the number of pixels 
increases, they may result in a bottleneck in producing the device. Thus, in an embodiment it is 
preferred to dispose these structural elements outside each pixel. 

In the structure of the pixel shown in Figure 8, in each of pixels 1-1 to pixel 1-n arranged 
in the vertical direction, only a light receiving portion and a first amplifying portion 20 are 
disposed. One second amplifying portion 30 is disposed for outputs of the pixel 1-1 to pixel 1-n. 
In other words, the second amplifying portion 30 is shared by a plurality of pixels on the same 
column. 

In addition, a pixel-outside storing portion 2-1 to a pixel-outside storing portion 2-n are 
disposed corresponding to the pixel 1-1 to the pixel 1-n, respectively. Each of the storing 
portions 2-1, ... contains a first storing portion 40-1 to a k-th storing portion 40-k. 

Conversely, a load portion and calculating portion 50 and an outputting portion 60 are 
shared by the pixel-outside storing portion 2-1 to the pixel-outside storing portion 2-n. Thus, 
even if the bias portion 55 is disposed in the photographing device, only one bias portion 55 is 
required for the load portion and calculating portion 50. 

Figure 9 shows another embodiment modifying the structure of the photographing device 
shown in Figure 1 and the structure of the pixel shown in Figure 2. In Figure 8, n pixels 
arranged in the vertical direction of the photographing device and a calculation processing 
portion are illustrated. In contrast, in Figure 9, such a circuit structure is repeated in the 
horizontal direction as pixels arranged in a matrix. 

In other words, in an embodiment of the photographing device shown in Figure 9, a pixel 
area is composed of m x n pixels arranged in the horizontal direction and the vertical direction of 
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a matrix. Below the pixel area, m second calculating portions 30 are disposed in the horizontal 
direction. Below the second calculating portions 30, a pixel-outside storing area is disposed. 
The pixel-outside storing area is composed ofmxn pixel-outside storing portions arranged in 
the horizontal direction and the vertical direction of a matrix. Below the pixel-outside storing 
area, an area composed of load portions and calculating portions 50 and outputting portions 60 is 
disposed. Below the area, a horizontal outputting portion 100 is disposed. 

As with the embodiment shown in Figure 1, a vertical driving circuit 80 supplies a light 
receiving portion drive signal 1 1 and a first amplifying portion drive signal 21 to the m pixels 
arranged in the horizontal direction. A second amplifying portion drive signal 31 is supplied to 
the second amplifying portions 30. A storing portion drive signal 41 is supplied to the pixel- 
outside storing portions 2. A calculating portion drive signal 51 is supplied to the load portions 
and calculating portions 50. An outputting portion drive signal 61 is supplied to the outputting 
portions 60. 

Outputs of the n pixel 1-1 to pixel 1-n arranged in the vertical direction are connected by 
vertical pixel signal lines 92. The signal lines are inputs of the second amplifying portions 30. 
Outputs of the second amplifying portions 30 are connected to all the n pixel-outside storing 
portion 2-1 to pixel-outside storing portion 2-n arranged in the vertical direction and inputs of the 
load portions and calculating portions 50. 

In an embodiment, the circuit structures and operational characteristics of the light 
receiving portions 10, the first amplifying portions 20, the second amplifying portions 30, the 
storing portions 40, the load portions and calculating portions 50, the bias portions 55, and the 
outputting portions 60 disposed in the photographing device shown in Figure 9 are substantially 
similar to those shown in Figures 3, 4, and 5. 

In an embodiment, the overall operation of the photographing device shown in Figure 9 is 
almost the same as that shown in Figure 1 except that drive signals for the second amplifying 
portions 30, the load and calculating portions 50, and the outputting portions 60 for n pixels 
arranged in the vertical direction are independent rather than in common. 

Figure 1 1 is a timing chart showing operational characteristics of the photographing 
device shown in Figure 9. The different between the timing charts shown in Figs. 1 1 and 5 is in 
that the write pulse (WR) for driving the read transistor (GR2) of the second amplifying portion 
30, the inverter pulses (CKA) and (CKB) for driving the inverter switch (SWA) and the inverter 
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switch (SWB) of the load portion and calculating portion 50, respectively, and the output pulse 
(CKO) of the outputting portion 60 are in common with n pixels arranged in the vertical 
direction. 

An application of the photographing device according to an embodiment will be 
5 described with reference to Figure 12 which schematically shows an active type distance 

measuring system for measuring the distance to an object (for details of the theory of active type 
distance measurement, refer to for example "Measuring three-dimensional picture" by Iguchi and 
Sato, Sho-ko Do). In an embodiment, shown in Figure 12, an object is composed of a plane and 
an almost semi-cylinder. The plane faces the measuring system. The almost semi-cylinder 
10 protrudes from the front. 

! ^ Slit-shaped laser light radiated from a semiconductor laser (or a light emitting diode) is 

a 

q reflected by a rotating mirror. The reflected light travels toward the object. When the radiation 

j'jj of the laser light is synchronized with the rotation of the rotating mirror, the laser light can be 

i;Q scanned in the left and right directions of the drawing. A camera can photograph laser light that 

i,n 

1 §| is radiated to the plane and the semi-cylinder time by time. The photographing device (see 

" Figure 1 or Figure 9) can be applied for the camera of the distance measuring system. 

□ 

Iff Figure 13 is a plan view showing an embodiment of the distance measuring system 

O 

j=P shown in Figure 12. The camera is composed of a photographing device of which a 

i'3 predetermined number of light receiving elements such as fine pixels are arranged in a two- 

j'U 

20 dimensional matrix shape, each of pixels being capable of detecting the intensity of received 

light. The camera can collect the reflected light of the object with a lens, photograph the object, 

and obtain the position of the received light. 

In an embodiment, one pixel P on the photographing device always observes only the 

direction of view line through the lens. The direction of view line is denoted by 0P. 
25 The rotating mirror that scans the laser light has its rotation center axis at the position 

apart from the optical axis of the lens by a distance B. Starting the rotation at time zero, the 

rotating mirror scans the slit-shaped laser light to the front surface of the object from the right to 

the left of the drawing. 

Since the pixel P observes only the direction 0P of view line, if the object is placed at a 
30 position I, as shown in Figure 13, only when the rotating mirror is rotated and the laser radiation 

angle becomes ©I can the pixel P receive the reflected light of the front surface of the object. 
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Likewise, if the object is placed at a position II, only when the rotating mirror is rotated and the 
laser radiation angle becomes ©II can the pixel P receive the reflected light of the front surface 
of the object. 

Thus, with a geometric calculation such as a triangulation, the distances LI and LII 
between the distance measuring system and the object can be expressed by the following 
formulas. 



Thus, with the radiation directions ©I and ©II of laser light received by the pixel P, the 
distances LI and LII to the object can be uniquely obtained. 

In an embodiment, both the radiation angles ©I and ©II can be expressed as functions 
with respect to elapsed time t after which the rotating mirror starts rotating. Thus, the distances 
LI and LII to the object can be expressed as functions with respect to time t. 

Figure 14 shows a temporal change of intensity of light received by the photographing 
device and a calculated result of which the change of the intensity is calculated by the 
photographing device according to an embodiment. 

In an embodiment shown in Figure 14, at time TI, the sign of the calculated result 
changes from minus to plus. Based on the change point of the sign, the peak time of the light 
intensity can be detected (however, in the embodiment shown in Figure 14, it is understood that 
the photographing device has an output characteristic in which the amount of current decreases 
in proportion to the amount of received light (namely, the intensity of received light). When the 
peak time of the light intensity can be detected, as was described above, the distance to the object 
can be obtained. 

In the embodiment shown in Figure 14, the calculating interval (namely, the sampling 
period of the photographing device) is denoted by AT. When AT is shortened, the resolution of 
the distance measurement can be improved. 

Next, the process that has been described with reference to Figs. 12 to 14 will be 
explained for an embodiment using a conventional photographing device. 



LI = 



£xtan07xtan0P 
tan 07 + tan ©P 



LII = 



BxXanQIIxianQP 
tan 0/7 + tan QP 
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The calculating interval AT is equivalent to the video rate, for example, around 30 Hz or 
60 Hz. Thus, when the object is moving, it is very difficult to accurately measure the distance to 
the object. 

Even if the object is motionless, to obtain the distance of the entire front surface of the 
5 object, it is necessary to scan laser at each photographing timing of 30 Hz or 60 Hz. Thus, it will 
take a very long time to measure the distance. 

Moreover, the time necessary for the picture process for obtaining the laser position 
based on the photographed picture cannot be ignored (i.e., it is not negligible). 

In contrast, when the photographing device according to an embodiment of the present 
10 invention is applied, the calculating interval can be remarkably shortened. Thus, even if an 
I object is moving, the distance thereto can be accurately measured. 

I «3 As described above, according to an embodiment of the present invention, an excellent 

!, 3 picture processing apparatus for obtaining the difference between picture frames can be provided 
i!0 so as to obtain a temporal change of brightness of an object. 

i Ji 

1,5 In addition, according to an embodiment of the present invention, an excellent picture 

^ processing apparatus of which a photographing device and a storing portion for storing 

uJ 

l,f| photographed data photographed thereby are disposed on the same circuit can be provided so as 

d 

, jj to perform a calculating process at high speed. 

O Moreover, according to an embodiment of the present invention, an excellent picture 

fU 

20 processing apparatus that allows characteristics of a storing portion to be suppressed from 

fluctuating and an accurately calculated output to be obtained in a situation of which a temporal 

change of brightness of an object is small can be provided. 

According to the structure of the picture processing apparatus in an embodiment of the 

present invention, since a storing portion and a photographing device are disposed on the same 
25 circuit, the process can be performed at high speed. In addition, since a bias portion adds an 

offset current to a current signal that is output from the storing portion and that has not been 

calculated, the influence of characteristics of the storing portion can be suppressed, thereby 

allowing an output of the calculating portion to become stable. 

For example, when the picture processing apparatus according to an embodiment of the 
30 present invention is used as a pixel and each pixel is arranged in a matrix shape on the same 

circuit, a photographing device with a calculating function can be structured. With the 
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photographing device, a temporal change of brightness of an object can be calculated at high 
speed. 

It should be understood that various changes and modifications to the presently preferred 
embodiments described herein will be apparent to those skilled in the art. Such changes and 
modifications can be made without departing from the spirit and scope of the present invention 
and without diminishing its intended advantages. It is therefore intended that such changes and 
modifications be covered by the appended claims. 
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